Absolutely. So easy to play off if you ever get called out on it in the future.
If you just give a different apartment number, though, if he ever comes looking and he has the right apartment complex, you may be easier to find than you think. Personally, I would give a different apartment complex. If it ever comes up, you can just say you had been looking at those apartments and got them mixed up, or were supposed to move there, but this new apartment came available at the last minute. But avoid that conversation at all cost, because you'll more than likely be expected, or feel the need to divulge your true address, and you can really only play this off once.
If you are moving out of town, just give them a different town address. An adjacent city, or town is easy enough to "visit" their hall while you fade, or in an "emergency" situation, but isn't in their territory, for them to happen upon you while in fs. And you can use the same excuse as above, or another, like; we decided at the last minute to move closer to work, or this new place was more convenient for work, etc...
As we were looking over the old place, a neighbor told us they had bedbugs/mice/mold/noisy kids/fight constantly/horrible odor/insert other horror story, so we opted for a different place.